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Foreword 


This  report  was  prepared  as  part  of  the  Markov  Models  of  Random  Urinalysis  Sampling  Pro¬ 
cedures  project  (Reimbursable,  Work  Unit  92PODD911)  and  the  Statistical  Methods  for  Drug 
Testing  project  (Program  Element  O30S889N,  Work  Unit  0305889N.R2143.DR001),  both  spon¬ 
sored  by  the  Chief  of  Naval  Personnel  tPERS-63).  The  objectives  of  the  projects  are  to  determine 
if  urinalysis  strategies  based  on  time  since  last  test  can  be  used  to  improve  the  Navy’s  drug  de¬ 
terrence  program  and  to  develop  a  unified  set  of  statistical  methodologies  for  the  analysis  of  drug 
testing  programs  and  data.  The  work  described  here  was  performed  during  FY92  and  FY93. 

This  is  the  second  in  a  series  of  reports  on  the  use  of  Markov  chains  for  the  analysis  of  random 
urinalysis  programs.  The  first  report  is  Markov  Chains  for  Random  Urinalysis  I:  Age-Test  Model 
(NPRDC-TN-93-5).  Related  work  also  includes  Probability  of  Detection  of  Drug  Users  by  Random 
Urinalysis  in  the  U.S.  Navy  (NPRDC-TN-93-2). 


MURRAY  W.  ROWE 
Director,  Manpower  Systems  Department 


Summary 


Background 

This  is  the  second  of  a  series  of  papeis  on  the  ise  of  Markov  char  us  to  model  random  urinalysis 
programs.  Previous  work  (Thompson,  Boyle  &  Hentschel,  1993)  introduced  the  age-test  Markov 
chain.  This  chain  was  used  to  model  random  urinalysis  strategies  stratified  by  time  since  last 
tested.  This  paper  extends  the  age-test  model  by  including  an  absorbing  state  for  detection  of 
drug  users. 

The  Nuclear  Regulatory  Commission  (NRC,  [1988])  proposed  a  urinalysis  testing  strategy  based 
on  time  since  last  tested.  That  is,  the  probability  of  a  person  being  tested  depends  on  the  amount 
of  time  since  the  person  was  last  tested.  Southern  California  Edison  (SCE)  has  implemented  a 
variation  (Murray  &  Talley,  1988)  of  the  NRC  proposal  at  the  San  Onofre  Nuclear  Generating 
Station  in  Southern  California.  We  have  shown  (Thompson,  et  al.,  1913)  that  age-test  urinajysis 
strategies  trade  off  predictability  of  an  individual  being  tested  for  fewer  people  not  tested  within  a 
year  and  fewer  people  tested  excessively  during  a  year. 


Objective 

The  objective  of  this  work  is  to  quantify  the  extent  to  which  age-test  urinalysis  strategies  can 
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Approach 

The  approach  includes  (1)  extending  the  age-test  model  to  include  an  absorbing  state  for 
detection  of  drug  users,  (2)  developing  the  needed  theory,  and  (3)  analyzing  a  number  of  specific 
age-test  urinalysis  strategies. 

Results 

We  define  a  class  of  age- test  models  extending  the  models  presented  in  Thompson,  et  al.  (1993). 
The  theory  and  formulas  for  calculating  the  distribution  of  time  to  absorption  (e.g.,  detection  of 
drug  users),  the  mean  time  to  absorption  and  the  expected  number  of  visits  to  intermediate  states 
(e.g.,  number  of  testo  prior  to  detection)  are  developed. 

This  model  is  used  to  analyze  three  age- test  strategies.  These  strategies  include  an  age-test 
model  of  the  NRC  proposal,  an  age-test  model  of  the  SCE  process,  and  an  age-test  model  meeting 
Navy  requirements  and  assuming  a  15%  monthly  testing  rate.  The  mean  times  to  detection  for 
the  NRC  proposal  are  58  and  200  months  for  nongaming  and  gaming  drug  users,  respectively.  The 
mean  times  for  the  SCE  process  are  46  and  84  months.  The  mean  times  for  the  Navy  model  are 
33  and  50  months.  These  results  are  based  on  age-test  models  assuming  drugs  are  detectable  in 
the  user  20%  of  the  time. 


Conclusions 


Markov  chains  provide  a  framework  for  the  systematic  analysis  of  drug  testing  strategics  strat¬ 
ified  by  time  since  last  tested.  Age-test  strategies  do  not  change  detection  time  for  nongaming 
drug  users.  As  long  as  the  annual  testing  rate  is  fixed,  average  time  to  detection  is  unchanged  by 
using  age-test  strategies.  Age-test  strategies  do  allow  gaming  drug  users  to  significantly  increase 
time  to  detection.  Constant  testing  strategies,  defined  by  equal  testing  probabilities  for  all  states, 
are  resistant  to  gaming. 


Contents 


1  Introduction  1 

2  Markov  Chains  2 

3  Age- Test  With  Absorption  4 

3.1  Time  to  Absorption  .  5 

3.2  Number  of  Tests  Prior  to  Absorption .  6 

3.3  Drug  User  Gaming .  6 

4  Applications  7 

4.1  Nuclear  Regulatory  Commission  (NRC) .  7 

4.2  Southern  California  Edison  (SCE)  .  9 

4.3  United  States  Navy . 9 

4  4  Relative  Merits .  10 

5  Conclusions  12 

6  References  13 

Appendix — Minimax  Gaming  A-0 

Distribution  List 


IX 


List  of  Tables 


1  Time  (in  Months)  to  I)et  for  Age-Test  Model  of  NRC  Proposal .  8 

2  Time  (in  Months)  to  Detectn  tor  Age-Test  Model  of  SCE  Process .  10 

3  Time  (in  Months)  to  Detection  for  an  Age-Test  Model  Meeting  Navy  Requirements  11 

4  Relative  Merits  of  Three  Age  Test  Strategies  .  12 

List  of  Figures 

1  Steady  state  distribution  of  number  of  tests  within  12  months  for  age-test  model  of 

NRC  proposal .  8 

2  Steady  state  distribution  of  number  of  tests  within  12  months  for  age-test  model  of 

SCE’s  process .  9 

3  Steady  state  distribution  of  number  of  tests  within  12  months  for  an  age-test  model 

meeting  Navy  requirements .  11 


x 


1  Introduction 


This  is  the  second  in  a  scries  of  papeis  on  the  use  of  Markov  chains  to  model  random  urinalysis 
programs.  Previous  work  (Thompson,  Boyle  and  Ilcntschel,  1993)  introduced  the  age-test  Markov 
chain.  This  chain  was  used  to  model  random  urinalysis  strategics  stratified  by  time  last  tested. 
This  paper  extends  the  age-test  model  by  including  an  absorbing  state  for  detection  of  drug  users. 

The  Nuclear  Regulatory  Commission  (NRC,  [1988])  proposed  a  urinalysis  testing  strategy  based 
on  time  last  tested.  That  is,  the  probability  of  a  person  being  tested  depends  on  the  amount  of  time 
since  the  person  was  last  tested.  Southern  California  Edison  (SCE)  has  implemented  a  variation 
(Murray  and  Talley,  1988)  of  the  NRC  proposal  at  the  San  Onofre  Nuclear  Generating  Station  in 
Southern  California.  Urinalysis  testing  strategies  based  on  time  last  tested  are  defined  by  (1)  a 
high  testing  rate  for  personnel  not  yet  tested  in  a  given  time  period  and  (2)  a  low  testing  rate  for 
personnel  found  to  have  negative  results  in  a  given  time  period.  The  NRC’s  adopted  rules  and 
regulations  (Nuclear  Regulatory  Commission,  1989)  for  urinalysis  do  not  require  a  time  last  tested 
strategy.  However,  SCE  continues  to  use  their  variation  of  this  strategy  with  NRC  approval. 

We  have  shown  (Thompson,  et  al.,  1993)  that  age- test  urinalysis  strategies  trade  off  predictabil¬ 
ity  of  an  individual  being  tested  for  reduced  t'lil  area  of  the  distribution  of  the  number  of  tests  in 
a  fixed  time  period.  Age-test  strategies  provide  fewer  people  not  tested  within  a  year  and  fewer 
people  tested  excessively  during  a  year  than  simple  random  sampling.  Age-test  strategies  ate  also 
more  predictable,  have  low.  variance  in  the  number  of  tests,  and  as  a  result  are  subject  to  gaming 
by  drug  users. 

Age-test  models  of  both  the  NRC  proposal  and  the  SCE  process  were  shown  to  have  undesirable 
properties.  The  NRC  proposal  required  that  at  least.  90%  of  the  individuals  be  tested  eac1'  year  and 
that  testing  rates  for  individuals  already  tested  witn  negative  results  be  at  least  2.5%  per  month. 
A  minimum  cost  age-test  model  wus  developed  for  this  proposal.  SCE  states  a  5%  annual  chance 
of  not  being  tested  and  a  130%  average  annual  testing  rate.  An  equal  cost  age-test  model  similar  to 
this  process  was  developed.  These  strategies  involve  large  differences  in  the  testing  rates  between 
people  tested  within  the  past  year  ar.d  those  wno  were  not  tested.  This  implies  that,  once  tested, 
an  individual  has  a  high  probability  of  not  being  tested  again  within  a  year.  These  probabilities 
are  0-74  for  the  age-test  model  of  the  NRC  proposal  and  0.48  for  the  age  trst  model  of  the  SCE 
process.  The  age-test  model  of  the  SCE  process  is  such  that  almost  half  the  tests  every  month  are 
given  to  people  who  know  they  will  be  tested. 

A  related  use  of  Maikov  chains,  modeling  classes  of  drug  users,  is  given  in  Evanovich  (1985). 
Previous  work  (Thompson  and  Boyle,  1992)  at  NPRDC  includes  models  of  detection  and  gaming 
of  drug  users  under  simple  random  sampling. 

This  paper  reports  on  our  work  to  quantify  the  extent  to  which  age-test  urinalysis  strategies 
can  be  gamed  by  drug  users.  This  paper  (1)  extends  the  age  test  model  to  include  an  absorbing 
state  for  detection  of  drug  users,  (2)  develops  the  needed  theory,  and  (3)  analyzes  a  number  of 
specific  age-test  urinalysis  strategies.  The  NRC  proposal,  the  SCE  process,  and  a  model  meeting 
Navy  requirements  are  analyzed. 


2  Maikov  Chains 


This  section  develops  the  tlieorv  and  notation  that  will  be  used  in  the  remainder  of  the  report. 
Here,  we  develop  the  formulas  for  calculating  the  distribution  of  time  to  absorption  (e.g.,  detection 
of  drug  users),  including  mean  time  to  absorption  and  for  cab  ulating  the  expected  number  of  visits 
to  intermediate  states.  It  can  be  considered  a  continuation  of  Section  2  cf  Thompson,  et  a].  (1993) 
Most  of  the  material  and  notation  is  taken  from  Taylor  and  Karlin  (1984)  and  Hoel,  I’ort  and  Slone 
(1972). 

Again,  we  consider  finite  state  Markov  chains,  but  with  the  following  special  structure.  The 
states  are  labeled  0, 1 ,. . . ,  A'  with  transient  states  0, 1, ...  ,r  —  1  and  aboorbing  states  r,  r  +  l, . . . ,  A. 
A  state  a  is  absorbing  if,  once  at  a,  the  chain  stays  at  a  for  all  time.  Also,  starting  at  any  transient 
state,  the  chain  must  be  eventually  trapped  by  one  of  the  absorbing  states.  The  transition  matrix 
for  such  a  Markov  chain  can  be  partitioned  as 


P  = 


Q  R 

O  I 


where  Q  is  an  r  x  r  matrix,  R  is  an  r  x  ( N  -  r  +  1)  matrix,  O  is  an  (N  -  r  +  1)  x  r  matrix  of  zero 
entries,  and  I  is  the  (N  —  r  +  1)  x  (N  —  r  +  1)  identity  matrix. 

Using  matrix  algebra  it  can  be  shown  that  the  n-step  transition  matrix  is 


Pn  = 


Qn 

O 

L 


(1  +  Q  4 - 1-  Q"~  *)R 

1 


(1) 


for  n  >  2.  Also,  from  page  20  of  Hoel,  et  ai.  (1972),  Qn  -*  0  as  n  c>o.  Thus,  the  infinite  series 
(I  +  Q  +  -  •  -  +  Q’l_1)  — *  (I  —  Q)_1  —  W  as  n  — *■  oo,  and  from  Equation  1 


liin  Fn  - 


O  WR 

O  I 


(2) 


Uet  u,a(n)  be  the  ith  row,  ath  column  entry  from  the  r  x  ( N  -  r  4  1)  submatrix  (I  +  Q  +  •  -  •  + 
Qn-!)R  ;n  the  Tl.step  transition  matrix,  Equation  1.  From  page  15  of  Hoel,  et  al.  (1972),  we  have 

u.o(u)  =  P[Ta  <  n,XT  =  a|A'0  =  i]  (3) 

where  Ta  is  the  time  to  absorption  by  state  a,  T  is  the  time  to  absorption  for  the  process,  and  t  is 
any  of  the  transient  states.  Equation  3  states  that  the  (»,  a)  entry  in  the  submatrix  from  Equation  1 
is  the  probability  that,  starting  at  state  i,  the  process  is  absorbed  by  state  a  within  n  time  periods. 
By  basic  probability  laws, 


Uio(n)  =  P\Xt  =  c|Ar0  =  »]  =  ultt. 

Thus,  uia  is  the  (»,  a)  entry  of  the  submatrix  U  =  WR  in  Equation  2,  and  we  have  observed  that 
the  entries  in  the  ith  row  of  U  represent  the  probabilities,  starting  at  state  i,  that  the  process  will 
be  trapped  by  the  \arious  absorbing  states. 


Another  way  to  establish  that  U  =  WR  is  to  employ  what  Taylor  and  Karlin  (1984)  call  first 
step  analysis.  Note 

=  P\XT  =  a|A'0  =  i] 

r  —  1 

-  P[A'r  =  a,  A',  =,  a| A'0  =  »J  +  £  P[XT  =  a,  A,  =  j|A„  =  i] 

;  =  0 

=  P[XT  =  ajA'i  =  a,  A'o  =  »)P{A,  =  a|A0  =  .] 

+  2  P[Xt  =  a]  A',  =  j,  X0  =  .]P[X,  =  j\X0  =  «] 

3=0 

T- 1 
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In  matrix  notation  the  above  relations  become 


(I-Q) 
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POa 

Pi  a 
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These  equations  can  be  summarized  in  the  single  matrix  equation  (I  -  Q)U  =  R  and  we  see  that 
U  =  (I  -  Q)-1R  =  WR. 


The  matrix  (I  -  Q)~*  =  W  is  often  called  the  fundamental  matrix.  First  step  analysis  can  be 
used  to  yield  a  probabilistic  interpretation  of  the  elements  of  W.  Let  i  and  k  be  transient  stetes 
and  set 

(T-l 


v,k  -  E 


£  U(A„)|Ao  -  • 


(4) 


n=0 


where  l*(An)  is  the  indicator  function  associated  with  state  k  The  expression  in  Equation  4  is  the 
expected  or  mean  number  of  visits  to  state  k  before  absorption,  given  the  process  starts  at  state  i. 
Using  conditional  probabilities  we  see  that 
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EE 
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P\  A,  =  a|A'0  =  »1 
P[A,  =  j\X0  =  «] 


(5) 


for  i,k  —  0, 1,. .  .,r  —  1.  The  last  equation  follows  since  P  is  stochastic  and  its  rows  sum  to  unity. 
tik  is  the  Kronecker  delta,  which  equals  1  when  t  =  k  and  equals  0  otherwise. 


] 


The  set  of  Equations  5  has  the  matrix  representation 


1  —  Poo  -put  -Por-l 

t>0* 

-Pio  1  ~  Pu  •  •  -Pi  r-i 

”1* 

.  “Pr-10  Pr  —  l  1  •••  1-Pr-tr-l  . 
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where  ek  is  the  Arth  column  of  an  r  x  r  identity  matrix.  Combining  all  systems  in  Equation  6  for 
it  =  0, 1 , . . . ,  r  -  1  leads  to  the  single  matrix  equation 


(I-Q) 


t>oo 


t’r-10 


•>Or-l 


t>,_J  r~l 


=  I 


(7) 


From  Equation  7  it  is  clear  that  =  tuv*,  and  te,*  equals  the  mean  number  of  visits  to  state  k 
from  state  »  before  absorption.  When  t  =  k  in  Equation  4,  the  expectation  counts  the  starting 
state  i  as  a  visit  to  state  i. 


Lastly,  define  Wk  as  the  number  of  visits  to  state  k  for  k  =  0, 1, . . . ,  r  —  1.  Clearly,  we  must 
have 

T  =  4  •  •  •  -f  Wr-t 

where,  again,  T  equals  time  to  absorption.  Hence 


£[r|A'0  =  «]  =  E 
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r-l 

=  Y  w'k 


k—0 


and  we  may  compute  the  expected  time  to  absorption  sta-ling  at  state  i  as  the  sum  of  the  elements 
in  the  ith  row  of  the  matrix  W. 


3  Age- Test  With  Absorption 


We  now  define  a  class  of  age-test  models  extending  the  models  presented  in  Section  3  of  Thomp¬ 
son,  et  al.  (1993).  The  transition  matrix  is 


(1  -  Oi)pj 

9i 

0 

0 

0 

«iPi 

(1  -  a3)pi 

0 

9J 

0 

0 

a2p2 

(1  -  «3)P3 

C 

0 

q3  ... 

0 

«3P3 

(1  -  aj)pj 

0 

0 

0 

<*dPd 

(1  -  a«M-i)p<i+i 

0 

0 

0 

Qd+i 

<*d+lPd+\ 

0 

0 

0 

0  ••• 

i) 

1 

(8) 
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In  Equation  8,  an  individual  is  in  state-  i  (1  <  t  <  d)  if  the  individual  tested  negative  i  time  periods 
ago,  and  in  state  d  +  1  if  tested  d  1  or  more  time  periods  ago.  The  p,’s  are  the  probabilities  of 
being  tested  given  state  t,  and  the  q,’s  are  the  conditional  probabilities  of  a  positive  result  given 
the  individual  is  tested.  State  d  +  2  is  1  he  single  absorbing  state  defined  in  Equation  8.  A  person  is 
absorbed  or  caught  if  tested  positive  To  summarize,  an  individual  residing  in  state  t  (1  <  i  <  d) 
must  in  the  next  period  test  negative  and  move  to  state  1,  age  to  state  t  +  1,  or  be  absorbed  to 
state  d  4-  2  by  testing  positive.  A  poison  in  state  d  - f  1  “ages”  by  staying  in  state  d  +  1. 

As  in  Section  3  of  Thompson,  et  al.  (1993),  we  impose  the  restrictions  9  <  pi, . . .  ,p<*  <  1  and 
0  <  Pd+ 1  <  1-  We  allow  the  a.’s  to  be  unrestricted  probabilities,  i.e.  0  <  nt , . . .  .a^+i  <  1,  except 
we  insist  at  least  one  of  the  o,\>  be  positive.  All  of  this  guarantees  that  states  1  through  d  +  1 
must  lead  to  the  absorbing  state  and,  by  Theorem  2  on  page  21  of  Hoel,  et  al.  (1972),  these  stales 
are  transient  and  the  results  from  Section  2  apply. 

3.1  Time  to  Absorption 

Using  the  notation  from  the  previous  section  we  have 

(1  -  «i)pi  9i  0  0  •  •  •  0 

( 1  -  )P2  0  q-i  0  •  •  •  0 

(1-03  )pj  0  0  q3  0 

Q  =  ,  R 

(l-a,i)p<i  0  0  0  •••  qd  o  dpd 

(T  -  arf+i)prf+i  0  0  0  •••  qd+i  J  [  ad+\Pd+i 

The  matrix  U  =  (I  -  Q)_1R  =  WR  =  1  is  a  (</  +  1)  x  1  column  of  l’s,  since  there  is  only  one 
absorbing  state  and  the  process  is  absorbed  with  certainty.  Also,  for  the  same  reasons,  T  —  Ta  ~ 
Td+ 1  and  {A'p  =  d+  1}  is  the  certain  event.  Thus,  from  Equation  2  of  Section  2,  we  have 

i(n)  =  P[T  <  n|A'o  =  j]  (10) 

equals  the  distribution  function  of  time  to  absorption,  conditional  on  the  process  starting  at  the 
transient  state  i .  This  is  precisely  the  ith  element  of  the  (d+  l)x  1  column  (I  +  Q  +  -  -  ■  +  Qn_1)R. 

We  can  also  define  the  mean  time  to  absorption  E{T\Xo  =  i)  through  a  limiting  argument. 
From  elementary  methods,  the  expected  value  of  a  random  variable  taking  on  positive  integer 
values  is 

n1*™1  +  0-^)1  (“) 

k=  1 

where  F  is  the  distribution  function  of  the  random  variable.  Applying  Equation  11  and  using 
Equation  10  yields 

n 

E(T\X0  =  0  =  1  +  Jirn^  -  «id+i(n)]  (12) 

n~’’0°  /t=i 

where  we  have  conditioned  on  the  event  A'o  =  i.  The  result  Equation  12  can  be  put  into  matrix 
terms  as 

1  +  Jlim  nl  -  [R  +  (I  +  Q)R  +  •  ■  •  +  (I  +  Q  +  •  •  •  +  Qn-1)R] 
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=  1  +  lim  nl  -  [fl  -  Q)WR  +  (I  -  Q2)WR  H - +  (I  +  Qr*)WR] 

n  -*oo 

=  1  +  lim  nl  -  [(I  -  Q)  +  (I  -  Q2)+ - 1-  (I  +  Q")]l 

n— *oo 

since  WR  =  1.  The  above  limit  reduces  to 

1  +  lim  nl  —  [nl  —  (Q  -f  Q2  +  ■  •  •  +  Qn)]l 

fl  “♦CO 

=  1+  lim  (Q  +  Q2+--  +  Qn)l 

n— ♦  oo 

=  1+  lim  [fl-  CT'^W-  Ill 

T)  — 'CO 

W1 

because  lim„_00  Q"'1'1  =  0.  Again  we  note  that  the  expected  time  to  absorption,  starting  at  state  i, 
is  the  sum  of  the  elements  in  the  sth  row  of  W. 

3.2  Number  of  Tests  Prior  to  Absorption 

Recall  from  Section  2  that,  in  general,  «;,*  equals  .e  mean  number  of  visits  to  state  k  prior  to 
absorption,  starting  at  state  i.  For  the  age-test  model  with  absorbing  state,  we  will  be  interested 
in  calculating  the  mean  number  of  tests  prior  to  absorption.  Since  testing  negative  is  equivalent  to 
visiting  state  l,  this  amounts  to  selecting  the  ith  element  from  the  fust  column  of  the  fundamental 
matrix  W. 

3.3  Drug  User  Gar  lg 

An  interesting  problem  arises  in  considering  the  process  of  Equation  8-  Given  a  fixed  set  of 
Pi' s,  a  drug  user  might  be  interested  in  choosing  a;’s  in  such  a  way  that  their  average  usage  rate  is 
at  a  desired  level  and  the  mean  time  to  absorption  is  a  maximum.  Here  we  define  the  usage  rate 
as 

y  _  QiW'i  + - H  a<i+iWd+i 

VFj  +  •  •  •  +  Wd+1 

where,  again,  represents  the  number  of  visits  to  state  k  prior  to  absorption.  The  average  or 
expected  usage  rate,  starting  in  state  i,  is  jE^yjA’u  =  »)  and  represents  the  average  percentage  of 
time  that  the  user  would  test  positive  prior  to  absorption.  Since  talcing  the  expectation  of  a  ratio 
of  random  variables  is  somewhat  intractable,  we  henceforth  approximate  the  average  usage  rate 
with  the  ratio  of  expectations,  i.e., 

£(K|A-„  =  t)  *  2L“il  +  ""1, 

t^il  H - +  W,rf+1 

Formally,  the  drug  user,  knowing  the  p,’s,  wishes  to  find  the  a,’s  that 

Maximize  £(T|Ab  =  t)  =  in;j  + - (•  tn,d+i  (13) 

„ubiect  to  a 

W'll  + - 1"  t^id+1 

0  <  a,  <  1  Vi 
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where  a  is  some  desired  average  usage  rate.  The  next  section  contains  a  number  of  examples 
illustrating  Equation  13. 

We  conclude  this  section  with  a  result  proved  in  the  Appendix.  If  the  p,’s  are  equal  in  Equation  9 
or  the  a,’s  are  all  equal  to  d  in  Equation  13,  the  mean  time  to  absorption,  starting  at  state  1, 
is  given  by  1/flqd.  Equal  p,’s  means  testing  rates  are  the  same  regardless  of  state  and  equal  a,’s 
means  drug  usage  rates  are  the  same  regardless  of  state.  Here  7Ti  represents  the  expected  number 
of  tests  per  time  period  foi  a  nonuser  starting  at  steady  state.  Sternly  state  is  defined  in  Thompson, 
etal.  (1993). 

This  result  is  very  important  for  two  reasons.  First,  urinalysis  strategies  with  equal  p, ’s  cannot 
be  gamed.  To  prevent  gaming,  age-test  urinalysis  strategies  with  unequal  p,'s  should  be  avoided. 
Second,  age-test  urinalysis  strategies  with  unequal  p,’s  do  not  change  mean  time  to  detection  for 
aongaming  drug  users.  Mean  time  tc  detection  for  nongaming  drug  users  is  only  a  function  of  the 
average  test  rate.  This  implies  age-test  strategies  are  not  problematic  if  gaming  is  not  a  concern. 


4  Applications 


Three  age  test  strategies  presented  in  Thompson,  et  al.  (1993)  are  revisited  here.  These 
strategies  are  the  age-test  model  of  the  NRC  proposal,  the  age-test  mode!  of  the  SCE  process,  and 
the  age  test  model  meeting  Navy  requirements  and  assuming  a  15%  monthly  testing  rate. 

The  number  of  tests  prior  to  detection,  and  the  time  to  detection  for  both  nongaming  and 
gaming  drug  users  is  presented  for  all  three  age-test  strategies.  Average  drug  use  (d)  for  all 
following  examples  is  0.20.  That  is,  drugs  are  detectable  in  a  user’s  system  an  average  of  20%  of 
time  or  about  6  days  per  month.  This  is  roughly  equivalent  to  using  drugs  twice  a  month. 

4.1  Nuclear  Regulatory  Commission  (NRC) 

The  Nuclear  Regulatory  Commission  (1988)  proposed  two  urnalysis  testing  alternatives.  One 
alternative  required  that  at  least  90%  of  the  individuals  are  tested  each  year  and  that  testing 
rates  for  individuals  already  tested  with  negative  results  be  at  least  2.5%  per  month.  The  age- 
test  strategy  {/q  =  p2  =  •  •  ■  ~  Pn  —  0.025  and  pu  —  0.6338}  is  the  least  cost  solution  to  this 
NRC  proposal.  The  distribution  of  the  number  of  tests  within  12  months  is  shown  in  Figure  1. 
By  contrast,  simple  random  sampling  at  the  103%  annual  rate  (same  rate  as  the  minimum  cost 
age-test  model)  gives  a  34%  chance  of  no  tests  and  a  7,7%  chance  of  3  or  more  tests. 

Time  to  detection  results  are  presented  in  Table  1.  Average  drug  use  is  the  same  (20%)  for 
both  the  nongaining  and  gaming  drug  user.  The  gaming  strategy  is  the  obvious  one.  Drug  usage  in 
state  13  is  set  to  zero.  To  keep  average  usage  at  20%,  drug  usage  in  states  1  through  12  is  increased 
to  22%.  The  average  time  to  detection  increases  significantly  from  58  months  to  200  months.  Also, 
the  average  number  of  tests  prior  to  detection  increases  from  5  to  17  tests.  If  detection  of  drug 
users  and  prevention  of  gaming  are  high  priorities,  this  age-test  strategy  should  not  be  used. 
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Probability 


Number  of  Tests 

Figure  1.  Steady  state  d'  tribution  of  number  of  tests  within  12  months  for  age-test 
model  of  NRC  proposal. 


Table  1 

Time  (in  Months)  to  Detection  for  Age- Test  Model  of  NRC  Proposal 


Drug  User 

Nongaming 

Gaming 

Mean 

58.2 

200.2 

1st  Quartile 

20 

58 

2nd  Quartile 

41 

128 

3rd  Quartile 

79 

278 
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4.2  Southern  California  Edison  (SCE) 


SCE  has  implemented  a  composite  random  sampling  (Murray  &  Talley,  1988)  approach  to 
urinalysis.  Their  approach  is  based  on  a  sampling  scheme  that  is  part  s;  npling  with  replace¬ 
ment  (individuals  are  subject  to  sampling  after  having  been  selected)  and  part  sampling  without 
replacement  (individuals  are  not  subject  to  sampling  after  having  been  selected).  The  entire  pop¬ 
ulation  is  sampled  at  a  specified  r.*te  with  replacement.  People  who  have  not  been  sampled  within 
the  past  year  are  sampled  at  another  specified  rate  without  replacement.  SCE  states  a  5%  an¬ 
nual  chance  of  not  being  tested  and  a  130%  average  annual  testing  rate.  The  age-test  strategy 
{pi  =  p2  =  •  •  •  =  P12  —  0.0598,  P13  =  1.0}  yields  similar  results.  The  distribution  of  number  of 
tests  within  12  months  is  shown  in  Figure  2.  Simple  random  sampling  at  the  130%  annual  rate 
gives  a  25%  chance  of  no  tests  and  a  13%  chance  of  3  or  more  tests. 

Time  to  detection  results  are  presented  in  Table  2.  The  gaming  strategy  is,  again,  the  obvious 
one.  Drug  usage  in  state  13  is  set  to  zero.  To  keep  average  usage  at  20%,  drug  usage  in  states  1 
through  12  is  increased  to  21%.  The  average  time  to  detection  increases  significantly  from  46 
months  to  84  months.  Also  the  average  number  of  tests  prior  to  detection  increases  from  5  to  9 
tests.  If  detection  of  drug  users  and  prevention  of  gaming  are  high  priorities,  this  age-test  strategy 
should  not  be  used. 


Figure  2.  Steady  state  distribution  of  number  of  tests  within  12  months  for  age-test 
model  of  SCE’u  process. 


4.3  United  States  Navy 

U.S.  Navy  policy  (Chief  of  Naval  Operations,  1990)  directs  commands  to  test  10-20%  of  their 
personnel  each  month.  Wc  developed  an  age-test  strategy  {pi  —  P2  =  P3  =  0.1,  P4  =  0.1145, 


Table  2 


Time  (in  Months)  to  Detection  for  Age- Test  Model  of  SCE  Process 


Drug  User 

Nongaming 

Gaming 

Mean 

46.2 

83.9 

1st  Quartile 

15 

24 

2nd  Quartile 

33 

58 

3rd  Quartile 

63 

116 

ps  —  ...  tz  p13  •=  0.2}  that  maximizes  the  number  of  people  tested  at  least  once  a  year  given  an 
average  monthly  testing  rate  of  15%  and  given  all  p,  between  10  and  20%.  The  midpoint  value  15% 
was  chosen  Although  the  Navy  does  not  use  this  strategy,  the  strategy  does  comply  with  Navy 
policy.  For  this  age- test  strategy,  the  distribution  of  number  of  tests  within  12  months  is  shown  in 
Figure  3.  Simple  random  sampling  at  the  180%  annual  rate  gives  a  14%  chance  of  no  tests  and  a 
8.2%  chance  of  4  or  more  tests. 


Time  to  detection  results  are  presented  in  Table  3.  A  gaming  strategy  that  seems  reasonable 
is  as  follows.  Drug  usage  in  states  1  to  3  is  increased  to  30%;  drug  usage  in  states  5  through  13 

IQ  tn  19%  Tn  avoraop  uf  9H%  nenrro  In  ctata  A  »e  cot  of  18  £»%  TKo 

— - ... - -  - - - r - *  *"0~ - 0~  »  “O  - - *  *w  ***' 

average  time  to  detection  increases  moderately  from  33  months  to  38  months.  Also,  the  average 
number  of  tests  prior  to  detection  increases  from  5  to  6  tests.  Since  this  gaming  strategy  yielded 
only  slight  gains,  we  calculate1  the  optimal  gaming  strategy.  Results  from  using  this  strategy  are 
also  included  in  Table  3.  This  optimal  gaming  strategy  is  100%  usage  in  state  1,  37%  usage  in 
state  2,  and  zero  usage  for  all  other  states.  Using  it  increases  the  average  time  to  detection  to 
50  months.  Although  this  strategy  does  not  seem  reasonable,  it  is  presented  to  show  the  optimal 
amount  of  gaming  possible.  This  age  test  strategy,  which  contains  no  large  differences  in  the  values 
of  the  s,  limits  the  amount  of  gaming  possible  for  users. 


4.4  Relative  Merits 

We  conclude  this  section  with  a  comparison  of  these  three  age-test  strategies.  Assume  Company 
XYZ  has  100C  employees  and  the  typical  drug  user  has  drugs  detectable  in  their  system  an  average 
of  6  days  per  month.  Also  assume  that  one  urinalysis  test  costs  S10.00.  A  comparison  of  the  relative 
merits  ol  the  3  age-test  strategies  is  shown  in  Table  4.  The  number  of  tests  per  year  is  simply  1000 
times  the  average  number  of  tests  per  person  per  year.  The  average  number  of  tests  per  person 
per  year  is  obtained  from  the  steady  state  distribution  of  the  Markov  chain  without  an  absorbing 
state.  The  table  also  includes  the  number  of  months  until  detection  with  probability  0.10,  0.50 
and  0.95.  Both  gaming  and  nongaming  times  are  presented.  The  optimal  gaming  strategy  is  used 
fo1  the  age- test  model  meeting  Navy  policy. 

'Excel  Solver  (Microsoft  Corporation,  1991)  was  used  to  solve  optimization  problems. 
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Figure  3.  Steady  state  distrib  ton  of  number  of  tests  within  12  months  for  an  age-test 
model  meeting  Navy  requirements. 


Table  3 

Time  (in  Months)  to  Detection  for  an  Age- Test  Model 
Meeting  Navy  Requirements 


Drug  User 


Nongaming 

Gaining 

Optimal 

Gaining 

Mean 

33.3 

38.3 

50.0 

1st  Quartile 

11 

11 

11 

2nd  Quartile 

24 

27 

33 

3rd  Quartile 

46 

53 

71 

11 


Table  4 

Relative  Merits  of  Three  Age-Test  Strategies 


Age- Test  Strategy 


NRC 

SCE 

Navy 

Number  of  Tests  per 

Year 

1030 

1300 

1800 

Cost  per  Year 

$10,300 

$13,000 

818,000 

Nongaming  User 

Time  in  Months 

Detection  Probability 

0.10 

13 

9 

5 

0.50 

41 

33 

24 

Gaming  User 

0.95 

163 

131 

97 

Detection  Probability 

0.10 

21 

9 

1 

0.50 

128 

58 

33 

0.95 

600 

250 

157 

Company  XYZ:  1000  employees,  typical  drug  user  has 
drugs  detectable  in  system  20%  of  the  time 


5  Conclusions 

Markov  chains  provide  a  framework  for  the  systematic  analysis  of  drug  testing  strategies  strat¬ 
ified  by  time  last  tested.  For  nonusers  the  steady  state  distribution  provides  estimates  of  the 
number  of  tests  per  month  and  the  number  of  people  who  have  not  been  tested  in  the  past  year. 
The  distribution  of  the  number  of  tests  in  a  fixed  time  period  (e.g.,  year),  given  any  initial  state, 
can  be  calculated.  Furthermore,  given  t  sting  cost  estimates,  the  relative  merits  of  different  testing 
strategies  can  be  easily  calculated.  For  drug  users,  the  distribution  of  time  to  detection  and  the 
expected  number  of  tests  prior  to  detection  can  be  calculated  given  any  initial  state. 

Age-test  urinalysis  strategies  trade  off  predictabil.ty  of  an  individual  being  tested  for  reduced 
probability  of  not  being  tested  and  reduced  probability  of  excessive  tests.  Thi:  educed  tail  area 
of  the  distribution  is  sometimes  perceived  as  more  equitable. 

Age  test  does  not  change  detection  for  nongaming  drug  users.  As  long  as  the  annual  testing 
rate  is  fixed,  average  time  to  detection  is  unchanged  by  using  age-test  strategies.  Therefore,  if 
gaming  drug  users  are  not  a  concern,  age-test  may  be  beneficial. 

Age-test  allows  gaming  drug  users  to  significantly  increase  time  to  detection.  The  more  ex¬ 
treme  the  age-test  strategy,  the  more  gaming  is  possible.  Extreme  strategies  have  large  changes  in 
probability  tested  over  time  (since  last  tested). 

Constant  testing  strategies  are  resistant  to  gaining.  Constant  strategies  are  defined  by  e  ;ual 
probabilities  of  testing  by  state.  Since  the  past  and  present  provide  no  information  about  the 
future,  gaming  as  defined  here  is  impossible. 
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Appendix 
Minimax  Gaming 


A-0 


Minimax  Gaming 


This  appendix  proves  the  result  mentioned  at  the  end  of  Section  3.3.  A  minimax  theorem 
associated  with  gaming  is  also  established. 


Recalling  the  definition  of  Q  from  Equation  9, 

wc  have 

«iPi  +  9i 

-?1 

0 

o 

0 

0 

«2?2  ~  Pi 

1 

“92 

0  ••• 

0 

0 

<*3P3  -  P3 

0 

1 

-93  ••• 

0 

0 

I-Q  = 

. 

. 

. 

. 

. 

<*dPd  ~  Pi 

0 

0 

0  ••• 

1 

-Qd 

.  Oj+iPj+i  —  pi+i 

0 

0 

0  ••• 
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We  are  interested  in  deriving  the  first  row  of  the  fundamental  matrix  W  =  (I  —  Q)"1.  The  first 
row  of  W  provides  the  mean  number  of  visits  to  each  transient  state  prior  to  detection  given  the 
system  starts  in  state  1.  First  we  calculate  the  determinant  of  (I  —  Q).  Expanding  by  elements  of 
the  first  column  yields 
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where  we  define  r,  =  ri}=i  Qj *  *  =  1, .  - .  ,d  -  1;  and  rd  =  (qx  ■  •  •  qa)/Pd+ 1  •  It  can  be  shown  that  the 
last  expression  in  Equation  A1  vanishes.  Thus 


DET(I  -  Q)  =  pd+l 


d+l 

OlPl  +  Y 


L  i=2  J 

Next,  observe  that  the  cofactors  of  the  first  column  of  (I  -  Q)  are 

[py+li  PJ+11"!)  Pd+lT2i  •••>  Pd+\^d—  li  Pd+ 


(A2) 


(A3) 


Since  this  row  equals  the  first  row  of  the  adjoint  of  (I  -  Q),  the  first  row  of  W  is  expression  A3 
divided  by  the  expression  in  Equation  A2. 

From  the  above  arguments,  we  can  write  Equation  13  of  Section  3.3  and  the  associated  con¬ 
straint  as 


Maximize  E(T'\Xq  =  1) 
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(A4) 
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subject  to  - =  o 

X>-. 

1=1 

where  we  set  r0  =  1.  The  constiaint  Equation  A5  can  be  solved  for  aj+i  to  yield 
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a<<+i  =  a  +  53  “^(tt  ~  «.)• 
r«< 


(A5) 


(A6) 


Since  irj  does  not  involve  the  a.’s,  maximizing  E(T\Xo  =  1)  with  respect  to  the  a,’s  is  achieved 
by  minimizing  the  bracketed  expression  in  Equation  A4.  Substituting  the  right  side  of  Equation  A6 
for  a<f+i  in  Equation  A4  leads  to 
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Recalling  the  definition  of  the  r,’s,  note  that 
d+ 1 
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by  an  induction  argument.  Thus  we  have  proved  that 
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(A7) 


and  maximizing  E(T\Xo  =1))  for  fixed  p,’s,  subject  to  Equation  A5  is  equivalent  to  the  optimiza¬ 
tion  problem 

d 

Minimize  a  +  53  r*-i(Pd+i  ~  P«)(»  -  «.)  (A8) 

i=i 

subject  to  0  <  a,  <  1;  i  =  1, . ..  ,d  (A9) 
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Because  of  Equation  A7,  we  have  shown 


£(T|Ao  =  1)  =  ~ 

7Ti  (i 

whenever  at  =  «2  =  . . .  =  a*  =  aj+i  or  pi  =  p?  =  . . .  =  pj  =  Pd+\ ■  This  gives  the  first  result. 

It  is  not  difficult  to  show  that  given  increasing,  not  all  equal  p,' s,  one  can  construct  a  feasible 
solution  to  Equations  A9  and  A10.  This  &olution  takes  the  following  form 

0  <  a‘k  <  1 

at+i»  ■  •  •  >q3+i  =  ®- 

By  inspection  of  all  cases  for  values  of  k  —  d  +  1,  d, . . . ,  I,  it  can  also  be  shown  that  a  solution  of 
this  form  will  provide  Equation  A8  strictly  less  that  a.  This  guarantees  that  the  objective  function 
A8  is  strictly  greater  than  I/trja.  Therefore,  the  maximum  expected  time  to  detection  for  the 
gaming  drug  user  is  minimized  when  the  pi's  are  equal.  This  establishes  the  minimax  theorem. 
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